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i-^ , Abstract 



Let p, q, n be natural numbers such that p + q = n. Let F be either C, the complex numbers 
field, or H, the quaternionic division algebra. We consider the Heisenberg group N(p, q, F) defined 
as N(p, q,¥) = F™ x JmF, with group law given by 
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00 
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(v, C)(«', O = (v + v',( + ('- ^3mB(v, u')) 



where B(v,w) = Ylj=i v j^j ~ Sj= P +i v j^j- Let U(p, q, F) be the group ofnXn matrices with 
coefficients in F that leave invariant the form B. In this work we compute explicit fundamental 
solutions of some second order differential operators on N (p, q, F) which are canonically associated 
to the action of U(p, q,¥). 



1 Introduction and Preliminaries 

X 

Let p, q, n be natural numbers such that p + q = n. Let F be either C, the complex numbers field, 
or H, the quaternionic division algebra. We consider the Heisenberg group N(p,q,¥) defined as 
N(p, q,¥) = F n x 3mF, with group law given by 

(v, C)(v', C) = (v + v',( + C- l^mB(v, , 

where B(v, w) = Ylj=i v j^j ~ 2~Zj= p +i v jWj- The associated Lie algebra is r](p, q, F) = F n © 3m(F), 
with Lie bracket given by 

[(v,0,(v',(')] = (0,-3mB(v,v')). 
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Let U(rj(j),q,¥)) be the universal envelopping algebra of rj(p,q,¥) which we identify with the algebra 
of left invariant differential operators. Let U(p,q,M) be the group of n x n matrices with coefficients 
in F that leave invariant the form B. Then U(p, q,¥) acts by automorphism on rj(p,q,¥) by 

9 ■ (v,0 = {gv,0- 

We denote by U(rj(p,q,¥)) u ^ p ' q ' VS) the subalgebra of U(r](p,q,¥)) of the left invariant differential oper- 
ators which commute with this action. It is known that this subalgebra is generated by two operators: 
L and U, and a family of tempered joint eigendistributions is computed explicitly (see for example 
[D-M], [G-S(l)], [V]). 

More precisely, if F = C and {X\, . . . , X n , Y±, . . . , Y n , U} denotes the standard basis of the Heisen- 
berg Lie algebra with [Xi, Yj] = 5ijU and all the other brackets are zero, then 

V n 

L = E X J+ Y ?- E X "+ Y f- 
j=i j=p+i 

For A £ 1, A / and feeZ, is a U (p, g)-invariant tempered distribution satisfying 

LS x ,k = -|A|(2fc + p - q)S x ,k, 

This family provides us an inversion formula: for all / in the Schwartz space on the Heisenberg group, 
we have that 

oo 

/M)=E / f * S x , k \M n d\, (z,t)€N(p,q,C). (1-1) 

If F = EI we take X{, Xf, Xf, . . . , X°, X\, X%, X*, Z u Z 2 , Z 3 } the canonical basis for the Lie 
algebra, where Z\,Z 2 , Z% generate the center of rj(p, q, H). Here, 

V 3 n 3 

L =EE(^) 2 - E E(^') 2 ' and 

r=l 1=0 r=p+l 1=0 

3 
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There also exists a family of U(p, q, H)— invariant tempered distributions ip Wt k, w G R 3 y k G Z, such 
that each one of them is a joint eigendistribution of L and U : 

Lp w ,k = -\w\(2k + 2(p - q))<p w ,k, 

in this case this family also provides an inversion formula: for all / G S(N(p, q,M)) we have that 

f(a,z) = Y J j(f*^,k)(a,z)\w\ 2n dw, (a,z) € N(p,q,M). (1.2) 

The aim of this work is to explicitly compute a fundamental solution in the classical case for the 
operator C a = L + iaJ7, where a is a complex number; and in the quaternionic case for the operator 
L. Recall that a fundamental solution for the differential operator C is a tempered distribution <I> such 
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that for all / in the Schwartz class, we have that C( f * $>) = (£/) * $ = / * £(<!>) = /. So if we define 
the operator K as Kf = /*<&, then K o £/ = Co Kf = f . 

From the inversion formula (1.1) it is natural to propose as a fundamental solution of C a 

oo 

< / >= V / 1 < S'A.fc, / > |A|"dA, (1.3) 

— |A|(2fe +p - q - a sgn A) 



for / € S(N(p, q, C)); and from (1.2) we propose as a fundamental solution of L 

<*,/>= V / i < ¥Vfc, / > kl 2 ™^, (1.4) 

-H(2fc + 2(p-g)) 

for/€5(iV(p, g ,M)). 

We remark that for q = 0, F = C we recover the fundamental solution for the operator C a given 
in [F-S], and for q = 0, F = HI we recover Kaplan's fundamental solution for the operator L given in 
[K]. The case q ^ 0, a = was obtained in [G-S(2)]. 

The expression of & a is obtained in theorem 2.9, and for the computation we follow the method 
used in [G-S(2)]. In the quaternionic case, <E> is given in theorem 3.1, and for its computation we use 
the Radon transform in order to reduce this case to the classical one. 

To describe both families of eigendistributions {S\ and {<p w k} we need to adapt a result by 
Tengstrand in [T]. We describe the elements for the case F = C, the other one is similar. First of all 

p n 

we take bipolar coordinates on C n for (xi,yi, . . . ,x n ,y n ) we set r = Yl (x 2 + y 2 ) — Y + Vj)i 

j=i j=p+i 

P = J2( x j +2/f)> u = {xi,yi,---,x p ,y p ), v = ( x P +i,y P +i,--- , x n,Vn)- Hence u = ( £ 1 L ) 2 u u , with 
i=i 

i. 

u € S' 2p ~ 1 and v = (^y~) 2 w v , with uj v G S 2q ~ l . It is easy to see by changing variables that 
f(z)dz=J J J ( (^Y~) (f~2~) u v\du u du v y. 

C n -OOp>| r | 52p-q x5 2q-l V / 

x (p + Tf-^p-ry^dpdT. 



Then we define for / G S 

S 2p-l xS 2q-l V ' / 

and also 

oo 

Nf(r) = J Mfip^ip + rf^ip-ry^dp. 

\r\ 

Let us now define the space H n of the functions ip : R — ^ C such that ip{r) = </?i(t) + T n ~ 1 ip2{r)H(T), 
for <pi,p2 G «5(M), where H denotes the Heaviside function. In [T] it is proved that T-L n with a 
suitable topology is a Frechet space, and following the same lines we can see that the linear maps 
N : 5(R 2n — {0}) — > 5(R) and N : 5(R 2n ) — > % are continuous and surjective. Let us consider now 
p G S^R 2 ™) 17 ^ 9 ), then it is easy to see that there exists a unique T G <S'(R) such that < p, f >=< 
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T, Nf >, for every / G S(R 2n - {0}). Moreover, if N' : W -> S^M 2 ™) is the adjoint map, by following 
again the arguments shown on [T] we can see that N' is a homeomorphism. Finally, for a function 
/ G S(N(p, q, C)) we write N /(r, i) for 7V(/(., i))(r). 
The distributions S'a^ are defined as follows 

S\, k = E x (h rn ,h m ), (1.5) 

{meNJ,B(m)=fc} 

p n 

where -B(m) = ]T mj — ^ m^, the set of functions {h m } C L 2 (M n ) is the Hermite basis and 
j=i j=p+i 

E\(h, h')(z,t) =< TT\(z,t)h,h' > are the matrix entries of the Schrddinger representation 7r A . Also, 
Sx,k = e~ M ® F Aifc , where each F A , fc G ,S'(<C™)^) is a tempered distribution defined in terms of the 
Laguerre polinomials L™ and the map N as follows: for g G S(C n ), A ^ and k G Z 

iffc>0, <F Aife , 5 >=<(Lt, ?+n _ 1J ff)("- 1 ),r^ A e -|iV 5 ^A r ^ >, and (1.6) 

if fe < 0, < F Ajfc , 5 >=< (LV^-^j'-V^ ^f^ 5 (~^f) > • (L7) 

For the quaternionic case we consider the Schrddinger representation ir w as given in [R] (see also 
[K-R]): 



w 



\w\ 



TT w (a,z) = TT lwl Q, < Z, — > , (1.8) 



where tt\ w \ is the Schrddinger representation for the classical Heisenberg group N(2p,2q,C). We have 
analogously that the distributions ip Wi k are defined by 

L Pw,k= ^2 E w (h m ,h m ), (1.9) 

meN2«:B(m)=fc 

2p 2n 

where B(m) = m i ~ Yl m j an d E w (h,h')(a,z) =< ir w (a, z)h, h' > are the matrix entries of 

j=l i=2p+l 

the Schrddinger representation tt w . Moreover, we have that <p w> k = e l<w,z> <g> 6 Wt k, where 9 w> k is a 
tempered distribution such that 9 W ^ = N'T\ w ^ k . If we set A = \w\, we have that T\ w y k = F\ : k where 
we replace n,p,q by 2n,2p,2q, respectively, in (1.6) and (1.7). Observe that if we define 

<P\,k(<*,z) = j e i<z ^>d^ Xik ( a ), (1.10) 
s 2 

this distributions are Spin(3) (8> U(p, q,M)— invariant. 



2 A fundamental solution for the operator C a 

We have that <J> a defined as in (1.3) is a well defined tempered distribution, and a fundamental solution 
for C a . We include the proof since a misprint in Lemma 1 of [M-R] is used in the proof Lemma 2.10 
of [B-D-R]. 

We will consider a G C such that 2k + p — q ± a / for all k G Z. 

Theorem 2.1. $ a defined as in (1.3) is a well defined tempered distribution and it is a fundamental 
solution for the operator C a . 
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Proof. From (1.3) and (1.5) we can write 

oo 

< S- X ,k,f> 



<<w> i <E / 

oo 



(2fc + p-g + a) 



+ 



< Sx,k,f> 



(2k + p — q — a) 



|Ar _1 dA < 



B08)=fc 



<E. x (hg,hB),f>\ \<E x (hs,hs),f > 



+ 



(2fc + p-g + a) | | (2k+p-q-a) 



\X\ n - L dX. 



From the known facts that £ £ p(£) = £ ( „"7 1 )p(^)) 

fc>0 



B(0)=* 



< E x (hp,h p ),f > | = | < ir\(f)hp,hp > | < ||/|| L i(iv(p, g ,c)) and that for m G N 

1 



(-l) m \X\ m (2B((3) +p-q + a sgn(A))' 



we get that 



< $ Q ,/ > I < H^ m /llLi(JV(p,9,C))X 



fc>0 



k + n — 1 
k 



in— 1— m 



+ 



IA 



n— 1— m 



2/c+p-g + a| m+1 |2fc+p-^-Q| m+1 



dA. 



Let us consider the first term, the second one is analogous. We split the integral between |A||2fc + p- 
<? + a| > 1 and < \X\\2k + p - q + a\ < l.Thus, 



|A||2fc+p- 9 +a|>l 



\2k + p - q + a\ m+l 



\X 



n—l—m 



dX 



is finite if we take m > n, and 

'k + n — 1 

k>0 



0<|A||2fc+p-g+<*|<l 



1 

\2k + p - q + a\ m+1 



|A| 



n— 1— m 



dX 



is finite for m < n. From the above computations it also follows that $ a is a tempered distribution. 
Next we see that it is a fundamental solution by writing L = Lq + Li, which in coordinates are 



\j=l j=p+l J 



+ £ 



j 
d_ 
di 



hi \ dx l Q y. 



E 

j=p+i 



Ox) + d y ] I ' 



i=i 



'i 



3 dyj a j dxj 



Then, as Lq,L\ and T commute with left translations and also Lo(g v ) = (LqqY , L\(g y ) = — (Lig) v 
and T(g v ) = -(Tg) v we get that 



(Cf * $ a )(z, i) =< $ a , (L {Zjt) -i/:/) v >=< $ Q , (L - ia)(L (Z)t) -,ff 
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because Li<fr a = 0. Hence, 



^ f < S\k,(L Q -iaT)(L (zt) -ify > 
K >y ' t^J -|A|(2/c +p - q - a sgn A) 11 

oo , 

_^ f <{Lo + iaT)S^{L {z , ) -,fy> 



■|A|(2fc+p- g - a sgn A) 

oo 

E / <^, fc ,(^)-i/) v >iAr- i dA = /(z,t), 



because of the inversion formula. The other one, / * C a (f) = f, is immediate. □ 

Now we proceed with the computation of & a . Given that the series (1.3) defining & a converges 
absolutely, we can split the sum over k G Z into the sums for fc > g, for fc < — p and for —p<k<q. 
In the first case we change the summation index writing k = k' + q and in the second as well, writing 
k = k' — p. So we get 



(-i) E ?irz^ / 1< S\,k>+ q ,f> - < s^ k ,_ p ,f>]\\\ n - 1 d\+ 

^2k+n- a J 

oo 

+ E 2fc , + w + - / [< s -^ +q j > - < s-x,- k '- P j >]\xr l d\+ 

k' ^0 q 

oo 

+ (-i) E / ( 4 s - x > kJ> + < Sx ' kJ> W^A. 

^ J \2k+p-q + a 2k+p-q-aJ l 1 



—p<k<q 



By Abel's Lemma and the Lebesgue dominated convergence theorem we can write <3? Q = <J>i + $2 
where 



00 

„2k'+n~a 



<$!,/>= lim lim(-l)V-^ / e" e|A| x (2.1) 

fc'>0 n 



x [< S Xi „ +q ,f> - < S x ^ k ,_ p J>] \X\ n - 1 dX+ 

00 

+ lim lim (-1) V — / e" e l A lx 

k'>0 q 

x [< S- X ,k'+ q ,f > - < S- X ,-k'-p,f>] |A| n_1 dA, 



00 



<$ 2 ,/>= lim(-l) E y"e HA| x (2.2) 



-p<k<q q 

• A./. - / > , < - S 'a./.-- / > \ , ,„_i 



+ — — lAr-^A. 



2fc + p — (7 + a 2k + p — q — a 
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Using that S\ t k = e %xt F\ t k and the computations from [G-S(2)], namely (2.6) to (2.9), we get 
that 



CO oo 

2k+n— a 

iXt , 



<*!,/>= lim lim(-l)V-^ / e" e l A l / 

r ^i-^o+ V J f^2k + n-aJ J 



x < (L° +n _ 1 iJ)^ n_1 \ A e -5[JV/(JLr,t) _ jv/(--|pt)] > dtdA+ 



2k+n+a 



Zk+n+a r r 

+ lim lim(-l)V / e~ e|A| / 

r^i-e^o+ V >{^2k + n + aJ J 

k>0 n _™ 



e at x 



x < (Ll^H)^, ^ e -^Nf(^T,t)-Nf(~T,t)] > dtdX, 



and setting 



we have that 



Now we define 



b k ,i = Yj 



k + n — 1 



n-2 / .x ✓ x 2-Z 



2k+n— a p p 

<*!,/>= lim limV- / e" 6 ^ / 



oo oo 



r->-l- e^0+ fr^ 2k + n 
k>0 



e~ iXt x 



oo 

(-If | L"- 1 (^|) e-^H sgn( S )iV/( s ,t)^+ 

n-2 



i=o 

Z odd 



|A|7 



9r' 



cftdA- 



+ lim lim N 



K .2fc+n+o 



r->l" <e->0+ ' 2/« + n + Q 



fc>0 

oo 



oo oo 

/-" A 7 



e iAt x 



(-If j L-- 1 e"^ |s| sgn( S )iV/( S ,^+ 



n-2 



1=0 
Z odd 



2 \ 



z+i 



d l Nf 



(0,t) 



cftdA. 



G / (r,t) = JV/(r,t)-X!^(0,*)^, 
and then we can split 3>i = <J>n + $12 where 



3=0 



(2.3) 



(2.4) 
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oo oo 

„2k+n— a 



with 



<$ n ,/>= lim Km V(-l) n -J / / e-^^e-^IAI"-^ (2.5) 

r ^i- e _> + £-! v 1 2k + n-aJ J 11 v; 

fc >° -oo 

oo 

x j U 1 - 1 (y! t |) e-^ lTl sgn(T)G f (T,t)dTdtdX+ 

— oo 

oo oo 

+ lim lim Y(-l) n ^- / / e-^VlAr-ix 

^^^ 0+ f^ 2k + n + aJ J 11 

fc >° -oo 

oo 

x J VI 1 (y! t |) e-^sgn(r)G f (T,t)dTdtd\, 



oo oo 



<$ 12 ,/>= lim lim V- / / e-^e-^IAP^x (2.6) 

r-H" e^o+ f^2k + n - a J J 1 V ; 

k >° -oo 

n ~ 2 ( 2 \ 1+1 d l Nf 
x2 E [jx\) (ak,l + b k ,i)-^-(0,t)dtd\ + 

l odd 

OO OO 
2 rZ ~ \~ TL ~ \~ Ct f /* 

+ lim lim V — / / e -e|A| e iAt| A |«-i x 

r^i- e^o+ f^2k + n + a J J 
k >° -oo 

71-2 / 2 \ i+1 d l Nf 
x2 E (^J (a k ,i + b Kl )^-(^t)dtd\ 



1=0 
I odd 



(2.7) 



oo 

a fe ,z = (-1)^ J Ll-\s)e-is l ds. (2.8) 



We will show that <&n is well defined. We have proved that the series (1.3) defining $ Q converges 
and as $2 is a finite sum we will obtain that $12 is also well defined. 

Proposition 2.2. The following identities hold: 
(i) 

00 

J e-^e- M L n k - 1 (B|r|) e^^Ar^A = 
—00 

= 4»(n - l)'(-ir (* + " " ^ f (H- 4e - 4 ^ fc ^ 
1 M j V fc / \(\r\+4e + 4it) k +») ' 
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(ii) 



lim 

e->0+ 



(\t\ -Ait-Ae) k 
\t\ + Ait + Ae) k+r 



sgn(r)G /(r, t)drdt = 



I 



1-7-1 - Ait 



(\r\ - 4it)5-f (| T | + 4it)3+S V^ 2 + 16t 2 ) 



2k+n—a 



sgn(r)G /(r, t)drdt. 



(Hi) 



lim 

<E->0+ 



(|r| +4it-4e) fc 
|rj - 4it + 4e) fc+n 



sgn(r)G j(t, t)drdt 



-I 



\t\ - Ait 



(\r\ - 4it)§-f (|r| + 4it)f +f V^ 2 + 16t 2 ) 



sgn(r)G j(t, t)drdt. 



Proof. From (4.9) of [G-S(2)] we know that (i) follows from the generating identity for the Laguerre 
polynomials: 

(2.9) 



i 



k>0 



(1 - z) n 



zt 

e 1 ~ z . 



From Lemma 2.2 of [G-S(2)l, which states that the function — G f( T '^ [ s integrable in M 2 and the 



fact that 



(|r|-4it) ^ 



l 



(|r|+4it)T 



1, it follows that the function 



(\r\-4it)^~^ (| T |+4it)7+Y 



integrable in M 2 . So we get (ii). For (iii) we just change e %xt by e lXt and argue like for (ii). 
Then, by Proposition 2.2, 

,,2k+n— a 



Gf(r,t) is 
□ 



< $n,/>= 0„ lim V 



r- >i- ' — ■ 2fc + n — a 

fc>0 



/( 



|r| - Ait \ 
r 2 + 16t 2 J 



2k+n—a 



sgn(r)G f (T,t) 



\t\ - Ait)2 2 (| r | + 4^)2 + 2 



-pr-rrdTdt + 



+ /3„ lim V] 



r 



2/c + n + a 



R 2 



fe>0 

|r|+4zt \ 2fc +"+ a 

r 2 + 16t 2 J (| r | + 4it)f +f (|r| - 4it)S"f 



sgn^Gj (r,t) 



drdt, 



where /3 n = 4"(n - l)!(-l) n ya t = (-l) fc . 

To study < $11,/ > we split each integral over the left and right halfplanes and take polar 
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coordinates r — Ait = pe 10 to obtain 

< $n,/>= P n lim Vflfc- 

r->i- rr - ! 2k + n — a 



2k+n— a 



k>0 



e i(2k+n-a)8 _J_ e ia8 ggn ( cos Q)Q f (p COS 8 ,- ^sin 8)d8+ 



/ e —i(2k+n-a)9 e ~ia9 
— ^ya^a-i — s S n (cos 6>)G/ (p cos 0, - - sin 0)d0 



dp + 



+ (3 n lim y^a k 



k>0 

7T 

2 



2A: + n + a 



■x 



x 



e -i(2k+n+a)e _J_ e iae ggn ( cos 0)^ (p C OS 0, - 1 SU1 0)fZ0+ 



/■ e i(2k+n+a)0 e -ia0 

+ / — ; — 7-, — ; \ — s g n (cos0)G/-(pcos0, — - si 



sin0)d0 



Now we change variable in the second and fourth term according to 8 < — > —8. Then, in the fourth 
term we change variables again according to 8 < — > 8 + 2ir. By proposition 2.2 we can interchange the 
integration order, so we can write 



< $n,/>= P n lim 

r— >l~ 



e x 



o -\ 



E 

fc>0 



J2k+n— a J2k+n+a \ 
J_ p i(2k+n~a)9 _|_ J_ p ~i(2k+n+a)9 \ 



2k + n — a 



2k + n + a 



x sgn (cos 9)Gf(p cos 9, — ^ sin 8)d8dp + 

OO 2 



E 

fc>0 



„2k+n—a 



2k + n — a 



e i(2k+n-a)6 _| ^ 



e -i(2fc+n+a)6» \ 

2k + n + a J 



x sgn (cos 9)Gf(p cos 9, ^ sin 8)d8dp. 

Let / denote the real interval [—§,§]■ Next let us consider the vector space 

X = [g G C n - 2 (I) : (±|) = 0, < j < n - 2, G L°°(J)} . 
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We identify each function g £ X with the function g on S 1 = l|, defined equal to outside supp(g) 
and we make no distinction between g and g. Thus, if g G X then g G C n ~ 2 (S 1 ) with g^^ 1 ) g 
L°°(S' 1 ). Observe that if g <G X, then also e* a6l g € A'. The topology on X is given by ||<7||;t = 
maxo<j< n _i||^||oo. 

For k G Z we set a k = ( fe+ £ -1 ) (-l) fe - Now let us define 

[ 2k+n-a i(2k+n-a)6 2k+n+ot -i(2k+n+a)9 \ 

* r , a (0) = J> fe -r- + -r— — , (2.10) 

^— ' * 2fe + n — a 2/c + n + a ' 



fc>0 



( e i(2k+n-a)e e -i(2k+n+a)d\ 
2kT^ + 2k + n + a l 9> > (2J1) 
/ 

and let us see that *f/ a G A'', the dual space of X. Indeed, 

(k+n-l\ ( \<e i{ - 2k+n ) e ,g>\ M , <e-^ 2k +"^ ,g>\ ■ 

fc>0 



^ |e 12^ fe J I \2k+n-a\ + 1 |2fc+ri+a| > (2.12) 



If g(n) =< g, e md > denotes the n— th Fourier coefficient of g, then we have that 

k n-i ( UM-^)(2k + n)\ \g&-±)(-2k-n) 
< -* a ,g > <cV l0 , ± ^77 r + iot.1 I 1 

^— ' 2A; + n \ n 1 \ 2fc + n — a\ \2k + n + a 



< 



fc>0 



< c ^ - Iff^" 1 ) (2k + n) | + - | £r C^-i)(— 2/c - n) | < 



k y " k' 

k>0 



1.2 

k>o K 



\g {n - 1] \\L 2 ; 



where we used the Cauchy-Schwarz inequality. Observe that the constants c are not the same on each 
expression. 

By Abel's Lemma, lim r _ > . 1 - ^ r ,a = in X' that is, with respect to the weak convergence topology. 
Similarly, if J denotes the real interval |7r] , we define the space, 



y = {gtc n -\j) 



■ gu) © = gij) (r) = °' - j - n - 2 ' 9(n ~ 1] e L °° (J) } ' 



and we obtain that ^f a is well defined in y' and lim $ r)tt = *$> a in y' . 

r— 

Our aim now is to compute 

From Proposition 3.7 of [G-S(2)] we know that if O G V^S 1 ) is defined by 



e(0) = iY / ( k + r ! ^(-l)^ 2 ^, (2.13) 



k>0 

then for even n we have that 

n-2 



Kee(fl) = ^Q„- 2 (|) (<k +<5_ f ) = X> , (2.14) 



3=0 

where Q n -2 is a polynomial of degree n — 2; and for odd n we have that 

n-2 



J 7 / 7 \ " — ~ 

jRee(0) = do^tf + ^Qn- 2 ( ^ )(*--*_-) = 4(5- f -<%) + £ - ( 2 - 15 ) 
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where Q n -2 is a polynomial of degree n — 2, and H(6) = H(cosO). 

Let us recall the generating identity for the Laguerre polynomials (2.9), and take t = and 
z = -r 2 e 2td . We get 

We also need a couple of results: 

Lemma 2.3. For a fixed r > 1 the functions a — > *r iQ (0) and a — > lim VEV,a(0) are analytic on 
n = C\F, where F = {2k + n : k € Z}. 

Proof. Let if be a compact set, if C $7. It is easy to see that for fixed r the series (2.10) converges 
uniformly, since 

|*r,a(0)| < max|r a | (j^a) d ( K > F ^ 
)• 

Theorem we have that for some £ <G (ri,?^), 



Also, for a S H there exists lim * r a (0). Indeed, if < ri < r < r 2 < 1, from the Mean Value 

r->l _ 

*n,a(0) - ^ 2 , a (0) = ^-*€, Q (0)(r 2 - n) = (r"" 1 + C' 1 ) E <**£ 2fc+ >2 - n) 



fc>0 

/ c \ n 

a— 1 i 1> 



(r^+r- 1 )^^) (r 2 - ri ), 

where the last equality holds from (2.16). Hence 

|*n 1 a(0)-*r 2l a(0)| < c(£)|r 2 - n|, 

where c(£) is a constant which depends on £. Moreover, for a G if and £ G l] , £ n_a ~ 1 + 

is bounded in K x [5,1], so the convergence is uniform, hence a —> lim \EV, a (0) is an analytic 

r— »1 _ 

function. □ 
Lemma 2.4. £e£ < 8 < \ . For < r < 1 and < |0| < 5 we have that 

\^r,a( e ) ~ *r,«(0)| < ( max e l 3ma ll»l ) (afr^ - r a \ + b\r a \{l - r)) \9\, 

with a, b positive constants. Also for < \6 — ir\ < 6 < \, 

|*r, Q ^)-* r , Q WI < ( max e^U ?) (a\r~ a - r a \ + b\r a \(l - r)) \9 - n\, 
\O<|0— 7r|<5 / 

with a, b positive constants. 

Proof. We will estimate |\DV ja (0) — \EV,a(0)| for < \9\ < S < |, the other case is similar. We have 
^rA°) = ™~ ia6 E «fc r2fc+ " (( r " a - r a )e i ( 2fc+n ^ + ( e *( 2fc +") e - e ^+n)eya^ = 

k>0 

( ( re id \ n f re ie \ n 
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because of (2.16). We have that 

4*r,aW <e^ ma ^ ( \r~ a -r a \ 



re 



i0 



I _|_ r 2gi26» 



+ 2|r c 



Jm 



re 



\ _|_ r 2 e i26 



(2.17) 



/ i8 \ n 

From Proposition 3.1 of [G-S(2)] we know that Jm ( x ™i e ae ) — > as r -> 1 , uniformly for 

|0| < f > 1^ - < f • Als ° ; ( i + r r 2ei2f) ) < c, for a constant c. Then |^*r,a(0)| — > uniformly on 
(9|<^asr— s>l~, and we get the desired inequality by applying the Mean Value Theorem around 
0. □ 

Now we can state the following 

p/ n + a \p/ n — a \ 

Proposition 2.5. For f & X we have that < / >= C a < 1, f >, where C a = 2 (n-i\i 2 >' 



for f Gy we have that < * Q , / >= C a < 1, / >, w/iere C a = (-l) n e-* a7r C a . 



Proof. First we consider f £ X such that J f(t)dt = and we define F(0) = J* f{t)dt. It is easy to 

7T 7T 

2 2 

see that F £ X and F' = f. Because of the integration by parts formula we have that 



<*a,f>=<* a ,F' >= / ^ 



i(2k+n-a)9 -i(2k+n+a)6\ 



,OCk 



+ 



2k + n-a 2k + n + 
< G, e^F > - < 0, e - iaf? F >, 



n fc>0 
2 



(6)d6 



where 6 = £ ( fc+ 2 _1 ) (-l) fc e - i ( 2fc+n ) e . So if n is even, from (2.14) we get that 

k>0 



n-2 



n-2 



< * Q , / >= - y Cj < + 5 U t 1] ,e- ia6 F > - y cj < 5 { i +1) + <5^ +1) , e~ iae F >, 

t-^ 2 — 2 — 

3=0 3=0 

and because < 8^tt_ l \ e~ lOLd F >= we conclude that < ^ a ,f >= 0. If n is odd we use (2.15) to 

^ 2 

conclude that < Vl/ a , f >= 0. 

7T 

For the general case of any f £ X we consider h <G X such that J_ 2 Z h(t)dt = 1 and define 

= /(^) ~~ ( /_ 2 i f{t)dt) h(6). So we can apply the above result to 5 and get that < ^ai9 >= 0. 
Then < * Q , / >=< * a , g > + < * a , h >< 1, / >=< * a , hxlj >. Let C a =< * a , ft >. 

7T 

4 

In order to compute C a , consider g G X such that supp(g) C ( — \ , ^), J" g{t)dt = 1 and # > 

— 7T 

4 

we have that 

2 

<e iae ^ a ,g>=C a J e iae g(e)d9, 

— TV 

2 

and also that 



<e ia ^ a ,g>= lim | / (tf,, a (0) - * r , Q (0))e lQ ^)^ + * r>a (0) / e K »g{0)dB\. 

r— >1~ 
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From lemmas 1 and 2 we get that 



C a = lim ¥ r , a (0) 



r— >1 



and also that C a is an analytic function of a. Given that *o,a(0) = we can write 



C a = lim * r>a (0) = *i, a (0) - * 0l a(0) = I w' a (s)ds, 



where 



w a (r) = * r>a (0) = r- a £ 



„2k+n 



2k + n — a ^— ' 2fc + n + a 

fe>0 k>0 



and we can solve the integral for 9\t(n + a) > 0, £He(n — q) > 0, getting 

- n + a n _ a \ _ r (2±a) r 



Cy* — -B 



(n-1)! 



(2.18) 



where 5 is the Beta function and T is the Gamma function. By lemma 2.3, (2.18) holds for the other 
range of a, by analytic continuation. In a completely analogous way we get that C a = (—l) n e~ ia7r C a . 

□ 



Let us now define ^ 

K if(p,Q) = ^^sgn(cos0)G/(pcos0,-^sin0), 

for G [— |, |] , < p < oo, where Gj is the function defined in (2.4); and 

K 2 f(p,0) = -^ T sgn(cos0)G' / (pcos0, |sin0), 



(2.19) 



(2.20) 



for G [f , §7r], < p < oo. 

It is easy to check that Kif(p, .) G ^f. Recall that we changed variables according to r — 4it = pe 10 . 
Since N f G H n , there exists a positive constant c such that 



sup \(t 2 + 16t 2 )Nf(T,t)\ < c, 

r^0,teK 



that is 



7V/(pcos0,-|sin0) 



c 

£ 7- 



Also since Nf(0, .) G <S(M), there exists a positive constant cn such that for t G 

n-1 



<"E5>/«>.'>7 



J=0 



Thus, for A G N there exists such that 



J! 



< catIt 



in-2 



K lf (p,6)\<— + 



<i b I cos 01™ 2 



p n+l p 7V+l | sin 0|JV 



(2.21) 



Analogous observations are also true for Kij. 
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Proposition 2.6. Let C a and C a be the constans obtained in (2.18). Let K\f and K 2 f be as defined 
in (2.19) and (2.20) and a k = {-l) k ■ Then 

7T 

r j- / r 2k-\-n— a p i(2k+n— a)6 r 2k+n+a p — i(2h+n+a)Q \ 

lim / e«^«J — + -— — }K lf (p,9)d9dp = 

r^i- J J f— ' \ 2k + n-a 2k + n + a 

= A n -\n-l)\C a [ [ ^— l —^- sgn (T)G f (T,t)dTdt, 

' ■ (r - Ait)— ( r + Ait) — 



r>0 



and 



77 7T 



lim 



V > / 2fc+n-a i(2k+n-a)9 2k+n+a -i(2k+n+a)6 \ 

p. / / e-E« 2t + n ._ a + 2fc + n + a . = 

g 7T fc>0 \ / 

= 4 n -\n-l)lC a [ [ ^— L_^ S5n(T ) G/ ( r)t ) drrf t. 

R r<0 v J y ' 

Proof. The proof follows the same lines that Proposition 4.2 of [G-S(2)]. We only sketch it for com- 
pleteness. 

Taking polar coordinates r — Ait = pe 10 we only need to show that 

oo oo 

lim_ J < V r:a ,e ia9 K lf (p,e) >dp = j < C a ,e ia0 K lf (p,9) > dp. (2.22) 
o o 

In order to do this we split the integral for < p < 1 and 1 < p < oo. 

oo 

We consider first the case 1 < p < oo. For |#| < 5 < f , set I = / / e iad (V r ,a{ d ) - 

i \e\<8 

^r,a{°)) K if(P^) ded P and 11 =1 I e iae (^ r:Ct {0) - C a )K lf (p,0)dOdp. We bound I close to by 

1 \0\<S 

applying Lemma 2.4 and taking N = 1 in (2.21). For II we just take N = \ in (2.21). To analize the 

oo 

case <5 < \0\ < § , we observe that the function K* f (9) = f K lf (p, 6)dp defined for 9 € [-§ , -<5] U [6, f ] 
can be extended to an element of X that we still denote by K*^. Then 

oo 

J I e ia9 (^ a (9)-C a )K lf (p,0)d0dp = 
1 <5<|0|<§ 

2 

= j e* ad (^ r , a (9)-C a )K* lf (9)d9- j e* a6 '($ r , a ffl - C a )K* lf (9)d9. 

7T I n I - r 



|0|«5 

The first term converges to zero as r — >■ 1~ since ^ r ,a — > C Q as r — >■ 1 _ in X'. For the second term we 
argue as above. 

»*— — -w-H 

□ 
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Corollary 2.7. < <&n, f > is well defined for f G S(M n ), and 

<^ 11 ,f>=4 n ~ 1 (n-l)\C a f f l — -- 1 —^ S g n (r)G f (T,t)drdt+ 



T>0 



+ 4 n " x (n- l)\C a 



r<0 



(r - 4it)~ (r + 4it)~ 



— sgn(T)G f {T, t)drdt. 



From the corollary we also get that < <3?i2, / > is well defined. In order to explicitly compute it 
we define for < I < n - 2, e > and / G 5(H n ) 



d~ l f = J J e - e l A l e - a *|A| n -'- 2 ^iV/(0,t)(it(iA, and 



-oo 



<,,/ = / / e-l A le^|Ar^ 2 |^iV/(0,t)^A. 



(2.23) 



(2.24) 



Then we can write (2.7) as 



-oo 



n-2 



<$ 12 ,/>= lim lim V V 2 l+2 (a kl + b kl ) 



k>0 1=0 

i odd 



2k + n - a de ' l ' f + 2k + n + a** 6 ' 1 '* 



From Lemma 4.4 in [G-S(2)] we deduce that 



"u + hi = 25=P3=r(i^'+ 1) C + 1 ~ 1 

Also we have the following 

Lemma 2.8. // < / < n - 2, e > and f G <S(M n ), i/ien 



lim dj~ 



e->0+ 



2 < • *m(t), 



an-2 



A / ' d\ n ~ l ~ 2 dr l 



Nf(0,.)>. 



Proof. Let us consider g(X) = e~ e l A l |A| n -^ 2 and h{t) = ^Nf(0, t), and observe that e~ iXt h(t)dt =| 
h(X). Then just by using properties of the Fourier transform we get that 

oo oo oo oo 

d lij = j j g(\)e- lXt h(t)dtd\ = j g(\)h(\)d\ = -^ r -- j _L-/^-<- 2 )(A)dA. 



-oo 



For each e > 0, --^j is a distribution such that there exists lim + --^j in <S'(R). Moreover, it is 



easy to check that 



7T 



lim 

e->o+ e + iX 2 



5 — i(vp) 



Thus the desired equality follows. For ^ we need to change variable according to A < — > —A 
after considering the Fourier transform of h. □ 
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We define for j G N, < j < n — 1, the functions of r, with < r < 1, by 



w 



w 



fe>0 



A; / 2k + n — q ' 



fc>0 



A; 7 2k + n + q 



We can see, in a complete analogous way as the computations made for C a and C a , that this 
functions are well defined and that 



cj := lim wj(r) = ±Bi - 2=2) , and 



r->l 



ct := lim w+(r) = \B, (2±2 j - 2±2) 



(2.25) 



r— ►! 



where Bi is another special function called the incomplete Beta function. 

2 

We now plug all of this definitions and results together to finally obtain an expression for $12: 



n-2 1+1 



<^/>=EE 22 " n+j+3 (ri+i 1 



1=0 j=l 
I odd 



x < 6, 



8 



n-2 



Q X n-l-2Q T l 
n-2 2+1 



Nf(0,.)> + 



1 



;n-(-2 j 



c - + z 



n-J-2 



7T 

C i) 2 



+ (-D ee ji - w (;:L";) (^7+'-' +i 4) 

J = 7 = 1 ' 



x < (vp) 



d 



n-2 



A 7 ' d\ n - l ~ 2 dr l 



Nf(0,.)>. 



All we need to do now is to use again lemma 2.8 to get an expression for <E>2. Thus, we have proved 
the following 



Theorem 2.9. Let C a and C a be the constans defined as in (2.18), and let c- and c\ the constants 
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defined as in (2.25). Then 

<$,/ >=4™- 1 (n-l)!C 

+ 4 n -\n-l)\C a 

n-2 l+l 



T>0 



71 — (X Tt-j- 

(r - 4it)~ (t + 4zt)~2 



^-sgn(r)Gf(r, t)drdt+ 




T<0 



(r - 4«t)~2- (r + 4it)~ 



— sgn(T)G f (T,t)dTdt+ 



+EE 22, -" +3+3 (n; 1 I 



=0 jr' = l 

/ odd 



;n-l-2 C J +l C J 2 



x < 5, 



d 



,n-2 



n-2 Z+l 



JV/(0,.)> + 



+ <-i)E£*™(?:;;)(^ 

i = 7 = 1 / V 



i + i c 7 + iB-,+lc i 1 < 



/ odd 

x < (up) 

n-2 n-2 

fc=0 z=o 



i \ a n - 2 
x) ' d\ n ~ l - 2 dT l 

i 



JV/(0,.)> + 



n-Z-2 



7T 



n - 2/c + a - 2 
1 1 



< -<5 + i(up) 



9 



n-2 



7T 



n - 2fc - a - 2 i"-'- 2 < 2 * ^ V A J ' dX^'W 



A / ' d\ n ' l ~ 2 dr l 

i \ a™- 2 



JV/(0,.)> + 



iV/(0,.)> 



^ere c fci = £ 2^-^" (-!)—•? (j) (^J 



l<j<n-2 

j>n-k-2 



3 A fundamental solution for L 

Like in the classical case, we have that the distribution defined in (1.4) is a well defined tempered 
distribution and it is a relative fundamental solution for the operator L. The proof is identical to the 
one of theorem 2.1. 

We will compute the fundamental solution $ by means of the Radon transform and the fundamental 
solution of the operator L in the classical case M 2n . 

Let F G S(R 3 ). We assign to F a function TIF : R x S 2 -> R defined by 



KF(t,£) = J F(t£ + u 1 e 1 +u 2 e 2 )du 1 du 2 , 



where {£, e\,e 2 } is an orthonormal basis of R 3 . It is easy to see that this definition does not depend 
on the choice of the basis. In order to recover F from 1ZF, we consider the space <S(K x S 2 ) of 
the continuous functions G : R x S 2 — > R that are infinitely differentiable in i and satisfy for every 
m, k G N that 



sup 



< oo. 



Now for G G S(R x S" 2 ) we define a function ft*G : R 3 -»■ R by 



7TG(z) = y G(<*, 



S 2 
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Both assignments are well denned, and moreover 7Z : S(R 3 ) — > <S(K x S 2 ) is the Radon transform, 
TV :5(Rx S 2 ) -> S(R 3 ) is the dual Radon transform and they satisfy for every F £ S( 



2ttF = A7l*KF, (3.1) 



where A = J^ + Jp- + J^is the M 3 — Laplacian. 

Now let us consider the function <f> defined for a fixed r, r 7^ by 

. , 16n 4 2n (2n - l)!c 
0(r, 2) - 



vr (r 2 + 16|z| 2 )™+ 1 ' 
1 

where Co = — / <j 2n_1 (l + a 2 ) 2n da. The function 0(r, .) is not a Schwartz function on M 3 , but we 


have that (1 + A)V(r, •) G L 1 ^ 3 ), nence i 1 + IC| 2 ) fc ^0v)(O G L°°(1R 3 ). With these properties the 
inversion formula for the Radon transform (3.1) still holds. The proof follows straightforward from 
theorem 5.4 of [S-Sh]. Let us now compute the Radon transform of the function (p. 

7cfl)(r,t,t)= / — -= -r, oT^ — --rduidu2 = 

y ' J it (r 2 + 16(t 2 + u 2 + u 2 2 )) n+l 

16n4 2n (2n- l)!c /" 1 
= n / rT du\du2 = 



(g + t 2 + K + «!))' 



2 m OO 



16„4-(2„ -I)!* j j__^_^ dpd0 



5 (S + * 2 + /)' 

4 2ri (2n - l)!c 
~ (r 2 + 16|z| 2 )"' 

where z = i£. Let </?(r, z) = ■ Now from the expression of the fundamental solution of L in 

the classical case (see for example 4.3 of [G-S(2)]) we know that 

00 

^.«)=E^/^r-QH)- w w 2 "-^. 

k>0 —00 V 7 

The first step to compute is to change to polar coordinates in M 3 the expression given in (1.4): 
<*'/>= E / -| A |(2fe+ 1 2(p- g )) < ^' f > H2UdW = 



3 
00 



s 2 

From the absolute convergence of (1.4) we can interchange the summation symbol with the integral 
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over S 2 . Because of Ae tX< ^' z> = — \X\ 2 e' lX< ^' z> , we have that 

oo 

<*,/>=/ E { 2k + 2(p-q)) J J eiA<5 * Z> ^^(«)/(«> z)dadz\\\^d\di : 

S 2 k& ' jV(p,q,H) 

oo 

= / E (2fc + 2(p- g )) / / Aea<f ' Z> ^.(«)/(«, z)dadz\\\^d\dH = 

S 2 keZ N(p,q,m) 

oo 

-/E (2fc+2 1 (p _ g)) /<^.A/>iAr-^. 

g 2 ftt<^ Q 



Next we break the summation indexes according to k > 2q, k < —2p and — 2p < k < 2q to get the 
splitting < / >=< <&i,/> + < $2, / >, and as in section we change summation index to get the 
series starting from k = 0. From the explicit definition of if\(,k we can write 



oc 



<*'-'>=/g^// 

S 2 fe - U R3 



e i\<£.,z> x 



x < T XM2q - T XMp ,NAf{.,z) > dz\Xr- L d\d^, 

where is defined by equations (1.6) and (1.7). By performing similar computations than in section 
2 and introducing the function 

G f (T,z) = Nf(T,z)- 2 jr^£f(0,z)^ 

3=0 J ' 

we get the splitting < 3>i, / >=< $n, / > + < $12, / >, where 

00 00 

S 2 - U R3 -00 



x sgn(r)L^- 1 {j\r^j er^ T \ AG f {r, z)drdz\X\ 2n - 1 dXd^ 



00 



<^,/> = 2/yj s l^//e^.'>x (3.3) 
x E (a) ("ki + hi)<5®,ANf(.,z)>dz\\\ 2n - 1 dZ, 

1=0 ^ ' 



and aki, are the same constant defined in (2.8) and (2.3), respectively. Now let us recall the fact 
that 

00 00 

i iX< t' z> F(\X\)dXd£ = ^J J e lX< t> z> F(\X\)dXd£, 

S 2 S 2 ~oo 



20 



and we apply the dual Radon transform to (3.2). 
Observe now that 

oo 

sgn(r)G/(r, z) 
(1 + 16|z| 2 ) n+1 




dzdr 



converges, which we can see by changing to polar variables in R 3 and arguing like in lemma 2.2 of 
[G-S(2)]. 

We finally get that 

* * 1 n 16n 4 2n (2n-l)!c . . , 

< $n,/>= - < -27T— p-L-—-^— , sgn^G/^z) >= 

= "4 2n+2 n(2n - l)!c < ^ - , sgn^G^T, z) > . 

We have thus proven that the expression defining $n is finite. Then the expression defining $12 
is also finite, and by Abel's lemma we can write 

2n ~ 2 r 2fc+2n 

< d> 12 , / > = 2 Inn M £ E 2 ' +1 (^ + 6 «)2j^*,«,/. 

fc>0 i=o 

i odd 

where 

00 

de,i,f = J J J e - tX e iX< t> z> \\\ 2n - 1 - 2 < 5^,ANf(.,z) > dzd\d£. (3.4) 

S 2 R 3 

We need to compute lim d e jj. Observing that Ae lX< ^ ,z> = — |A| 2 e lA< ^ ,2> , we have that 
d eM = {-l) l+1 J J je-^e iX <^>\\\ 2n - l ^Nf(0,z)dzd\d^ = 

S 2 R 3 

= (-l) m J J e- e ^\x\ 2n - l - 2 e i<x ' z> -^- i Nf(0,z)dzdx, 

R 3 R 3 

where we have changed to cartesian coordinates in R 3 . To solve this integral let us observe that 

(-l) 2 «-'-V^|x|--'- 2 = g^P e (x), 
where P e (x) is the Poisson kernel and "denotes the Fourier transform. Let us write 

de,U = ("I)' J g^zi- 2 P^) {gJ N m ■)) (x)dx = (-1)'^-^ * h){0). 

R 3 

Taking limit as e — > + we obtain 

al 

lhn = (-l)(-A)^^iV/(0,0), 
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where (—A) 2 is a fractionary exponential of the Laplacian (see for example [S-Sh]), which is the 
operator defined for g € <S(M 3 ) by 



This computation together with proposition 4.8 of [G-S(2)] lets us write 



2n-2 l+l 



1=0 j=l 

I odd 



< *«■ />= EE •>*, , (T_ /_ i 1 ) (-ix-a^^jWo, 0), 



2n-i-2 

d?' 



where each Cj is the constant defined in Remark 4.7 of [G-S(2)]. 

After performing the usual computations for $2 we have proved the main theorem of this section: 

Theorem 3.1. Let cq and Cj be the constants defined above. Then 



1 



<*,/>= -4 2 "+ 2 „(2n- I)!*, < (r2 + 16N2)n+1 , s 9 n(r)G f (r,z) > + 



2n-2 l+l 



1 /2n — 7 — 1\ , . . . . 2n-i-2 d l , . 

E-,2„ 2/ ; ,o( )(-l)(-A)^- 5F JV/(0,0)+ 



i=0 J: 

1 odd 



2 2n-2i-j-3^^ 



+ E 

-2g<fc<0 



2fc + 2(p - 5) 



r=0 V r / 



x(-l)(-A)^— 7V/(0,0)+ 

2n-2-fc-2p 



— ,_ fc / _fc - 2 p + 2n - 1 \ fl + k- 2p\ 

U K ' \2n-2-l-k-2p) \ r ) 



x{ _ 1)2 -l- k +2 P +2r+i { _ A) ^F NmQ) 



+ E 



2k + 2(p - g) 



dt 

-k+2q-l 



+ 

r=0 ^ ' ' 



0<fc<2g 

x2fc - W l ( _ ir( _ A) ^^ JV/(0j0)+ 



+ E (- 1 ) 



V2n - 2 - / + k - 2q 



E 

r=0 



xr l W+ l ( _ ir( _ A) ^^ /(0)0) 



Remark 

Let A'" be a group of Heisenberg type and let 77 be its Lie algebra. So rj = V ©3, with dim V = 2m and 
dim 3 = k. Let U (V) be the unitary group acting on V. Then it is known ([R]) that (N x U(V), U (V)) 
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is a Gelfand pair, and also in [R] were computed the spherical functions. We fix an orthonormal basis 
of V, {X\, . . . , X2 m }, and consider the operator 

2m 

With the same arguments as above, using the Radon transform in M. k and the fundamental solution 
of L in the classical Heisenberg group 2m + 1 dimensional, we can recover the fundamental solution 
of L (see [K], [R]). 
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